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Abstract. We present the results from adaptive optics (AO) assisted imaging in the Ks band of an area of 
15 arcmin^ for SWAN (Survey of a Wide Area with NACO). We derive the high resolution near-IR morphology 
of ~ 400 galaxies up to Ks ~ 23.5 in the first 21 SWAN fields around bright guide stars, carefully taking into 
account the survey selection effects and using an accurate treatment of the anisoplanatic AO PSF. The detected 
galaxies are sorted into two morphological classes according to their Sersic index. The extracted morphological 
properties and number counts of the galaxies are compared with the predictions of different galaxy formation and 
evolution models, both for the whole galaxy population and separately for late-type and early-type galaxies. This 
is one of the first times such a comparison has been done in the near-IR, as AO observations and accurate PSF 
modeling are needed to obtain reliable morphological classification of faint field galaxies at these wavelengths. 
For early-type galaxies we find that a pure luminosity evolution model, without evidence for relevant number and 
size evolution, better reproduces the observed properties of our .K's-selected sample than current semi-analytic 
models based on the hierarchical picture of galaxy formation. In particular, we find that the observed flattening of 
elliptical galaxy counts at Ka ~ 20 is quantitatively in good agreement with the prediction of the pure luminosity 
evolution model that was calculated prior to the observation. For late-type galaxies, while both models are able to 
reproduce the number counts, we find some hints of a possible size growth. These results demonstrate the unique 
power of AO observations to derive high resolution details of faint galaxies' morphology in the near-IR and drive 
studies of galaxy evolution. 

Key words, galaxies: fundamental parameters - galaxies: statistics - infrared galaxies - instrumentation: adaptive 
optics 



1. Introduction 

One of the main objectives of modern astrophysics is un- 
derstanding the process of galaxy formation and evolution. 
The best way to tackle this issue is studying the properties 
of galaxies observed at the epoch of their formation and 
early evolution, such as their stellar population, history of 
mass assembly, morphology, metallicity and interplay with 
the intergalactic medium. However, disentangling these 
processes in nearby systems is already extremely difficult. 



Send offprint requests to: G. Cresci 
e-mail: gcresci@arcetri.astro.it 

* Based on observations collected at the European Southern 
Observatory, Chile under programs 70.B-0649, 71.A-0482 and 
073.A-0603. 



and the challenge is even greater at higher redshift, where 
sources are compact in size (~ 0.1" — 0.3") and larger 
galaxies are rare (e.g., Bouwens et al. l2004|l . To resolve and 
study the details of high-redshift galaxies using ground 
based telescopes, which can provide larger samples and 
deeper observations than space-based observations, it is 
necessary to overcome the blurring effects of the atmo- 
sphere through the use of adaptive optics (AO) systems. 
These can allow ground-based telescopes to operate at or 
near the diffraction limit in the near-infrared (~ 0.07" in 
K band for an 8 m telescope) , resulting in a high angular 
resolution and a low background in each pixel. 

Besides the technical advantages afforded by AO, near- 
infrared surveys provide one of the best opportunities 
to investigate the cosmic evolution of galaxies and their 
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mass assembly. In particular, i^T-band (2.2 /im) selected 
samples are ideally suited for addressing the problems 
of galaxy formation and evolution. First, since the rest 
frame near-IR luminosity is a good tracer of the galaxy 
stellar mass (e.g., Brinchmann & Ellis l2U(jni Bell & de 
Jong l2(J(]n Mannucci et al. ' 2(J(J5|I . isT-band surveys allow 
us to select galaxies according to their mass up to z ~ 1.5 
(Arcst ~ 0.9 — 1.0 /xm), rather than suffer strong biases to- 
wards star-forming and peculiar galaxies like optical sur- 
veys (e.g. Drory et al. 12(7(74 . Fontana et al. l2()()4|l . Another 
strong argument for selecting galaxies in the near infrared 
is that, due to the similarity of the spectral shapes of dif- 
ferent galaxy types and stellar population ages in the rest 
frame near-IR over a wide redshift range (e.g., Mannucci 
et al. l2001|l . the selection of galaxies in the K band is not 
affected by strong fc-correction effects (e.g., Cowie et al. 
I1994|l . In contrast, selection in the / band becomes very 
type sensitive beyond z = 1, and the situation is even 
more extreme in the B band, where the fading of early- 
type galaxies is substantial even at modest redshifts. Thus, 
near-IR samples do not depend as strongly on galaxy type 
as optically selected ones, which are more sensitive to re- 
cent and ongoing star formation activity (as they sample 
the rest-frame UV light) and are biased against old and 
passive or weakly star-forming galaxies. 

Finally, near-IR surveys are less affected by dust ex- 
tinction than optical ones, making it possible to select 
highly extinguished star-forming galaxies. The observa- 
tion of the obscured dusty star formation rate is crucial for 
measuring the global star formation history. Calculations 
based on the observed rest frame UV flux (e.g., Madau 
et al. 119961 Connolly et al. I1997|l might be significantly 
underestimated if a large fraction of the overall star for- 
mation at high redshift takes place in highly obscured star- 
burst galaxies (e.g., Steidel et al. lTM??! Blain et aL lMl^ . 

Morphology is one of the most appropiate ways to 
characterize the properties of galaxies, and we will only 
reach a complete understanding of galaxies by deriving 
the mechanisms responsible for their morphologies. In this 
context, the study of galaxy size, and of the evolution of 
other galaxy properties according to morphological type, 
have made use mainly of the classification derived from 
deep optical HST imaging (e.g., Simard et al. 1999, Labbe 
et al. l^OnSl Trujillo & Aguerri l^UUl Pannella et al. lM75|l . 
due to the higher angular resolution achievable at opti- 
cal wavelengths with HST. However, near-infrared mor- 
phology is a better tracer of the underlying mass dis- 
tribution, as it is not biased towards recent star forma- 
tion and is less affected by dust obscuration. By using 
adaptive optics, it is now possible to push the analysis of 
source properties (surface density, magnitude, color, mor- 
phology, etc.) as a function of source size in the near- 
IR to an entirely new regime, and study sources that 
are both faint and compact. Ample evidence already in- 
dicates that such source populations do exist - e.g., a 
large fraction of the Hab < '2,1 sources detected by Yan 
et al. I|1998|l are still unresolved at the ~ 0.35" resolu- 
tion provided by HST/NICMOS in the near-IR. The AO- 



corrected, diffraction-limited, near-IR PSF of an 8 m tele- 
scope is a powerful tool to study this kind of object, since 
the angular resolution it yields is even higher than can be 
obtained by HST at this wavelength. 

Although the advantages of near-IR AO observations 
for studying how galaxies form and evolve in the early uni- 
verse are clear, until now there have been only a few at- 
tempts using natural guide stars (NGS; see e.g., Larkin et 
al. I2()()()l Classman, Larkin & Lafreniere 120021 Steinbring 
et al. 120041 Minowa et al. I2()()5|l . due to the very small 
number of known extragalactic sources lying at distances 
< 30" from bright iV ^ 13) stars needed to correct 
the wavefront for AO guiding, and to the problems aris- 
ing from the anisoplanaticism of the PSF in AO observa- 
tions. The prospects for AO cosmology will undoubtedly 
improve with the widespread adoption of laser guide star 
(LGS) systems, since these impose less stringent require- 
ments on the brightness of stars used for tip-tilt correction 
(e.g., Melbourne et al. I2005p . However, to overcome the 
present shortage of targets for AO cosmology, it is neces- 
sary to identify and characterize extragalactic sources in 
the vicinity of bright guide stars (see e.g., Larkin et al. 
[T^ Davies et al. 200T| Christopher & Small IMTSji . 

We therefore undertook a campaign of seeing-limited 
near-IR imaging of fields selected around stars bright 
enough for AO guiding (10.3 <R< 12.4), blue {B-R< 
1.1, in order to maximize the amount of light on the wave- 
front sensor), lying at high galactic latitude (|&| > 15deg, 
to minimize extinction and contamination by foreground 
stars), and with a declination suitable for observations 
with the ESO Very Large Telescope at low air mass 
(-44deg < ^ < -13deg). A total of 42 southern bright 
star fields (SBSFs) were selected and observed at seeing- 
limited resolution in band with SOFI at the ESO New 
Technology Telescope. More details about the target selec- 
tion and data can be found in Baker et al. pMji . The 
same fields have been followed up at optical wavelengths 
(Davies et al. I200ti|l . and are now targets for VIMOS in- 
tegral field optical spectroscopy at the ESO Very Large 
Telescope (VLT). 

In this paper we present the results of our i^s-band 
AO imaging survey of the first 21 fields in the framework 
of SWAN (Survey of a Wide Area with NACO), which is 
the AO-assisted result of these seeing-limited preliminar- 
ies. The survey will be introduced in the following section, 
and the observations will be briefly described in section|3 
The data reduction approach will be presented in section 
01 while the detection criteria and technique will be dis- 
cussed in section O The extraction of the morphological 
parameters of the detected galaxies is analyzed in section 
El and the method used to distinguish between stars and 
galaxies is described in sectional In section|Hlwe take into 
account the selection effects present in our data, discuss 
the completeness of the survey, and show the corrected 
number counts. The number counts and size-magnitude 
relation of the full sample of galaxies and for late and 
early-type systems separately are compared with the pre- 
dictions of two different galaxy evolution models in section 
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IHl our conclusions follow in section^] All the magnitudes 
are Vega relative unless otherwise specified. 

2. The Survey of a Wide Area with NACO 

Having already characterized large samples of objects in 
bright star fields, as described in the previous section, we 
targeted them with NACO on the VLT in order to ex- 
ploit the present generation of AO technology for galaxy 
evolution studies. NACO comprises the NAOS Shack- 
Hartmann AO module (Rousset et al. I2UI)3|I mated with 
CONIC A near-infrared camera (Lenzen et al. 11998(1 . Our 
choice of NACO observing mode was dictated by our 
desire to complement previous HST/NICMOS surveys. 
First, we chose to image in K^, where NICMOS is less 
sensitive than in J and H , thus making SWAN preferen- 
tially sensitive to red objects. Second, we chose to priori- 
tize survey area over depth, in order to optimize the study 
of the galaxies over the last half of the Hubble time and 
improve SWAN's sensitivity to rare objects and its robust- 
ness against cosmic variance (the latter already enhanced 
by the survey's peculiarity of patching together small fields 
at different locations on the sky). Use of NACO's 0.054" 
pixel scale (to maximize the field of view) and the Strehl 
ratios of 30-60% typically achieved in Kg result in im- 
ages that are slightly undersampled. As the AO PSF is 
quickly changing both in time and position on the frame, 
in order to extract full information from our wide-field ob- 
servations we have developed a new approach to account 
for the anisoplanatic PSF. The method was presented in 
Cresci et al. H2()()5|l . hereafter Paper I, along with some 
examples of galaxy morphology fitting using the derived 
model PSF. 

Each NACO pointing provides a usable ^ 0.75 arcmin^ 
of the full 55.5" x 55.5" detector area, due to losses 
from dithering and the central star (see, e.g., Fig. QJ. 
Nevertheless, the anticipated survey area that will result 
from assembling 42 such images will be - at 30 arcmin^ 
- some six times larger than the NICMOS survey of the 
HDF and flanking fields in J and H (Dickinson 199&. 
Dickinson et al. I2000|l . SWAN aims to combine the high 
angular resolution of a space-based survey with the shal- 
lower depth and wider area of a ground-based survey, 
thereby probing sources that are compact, faint, red, and 
rare more effectively than any other survey to date. 

3. Observations 

The first 21 SWAN fields were observed in band with 
the NACO AO system at the VLT, using the visible Wave 
Front Sensor (WFS). An example of a SWAN image is 
given in Fig. ^ Table ^ summarizes other observational 
parameters and the AO system performance during the 
observations. The SBSF name is given in column [1], and 
the coordinates of the guide star in the center of each field 
are given in [2] and [3], accurate to ±0.2". Column [4] re- 
ports the date(s) on which each field was observed. The 
total integration time on each field is given in [5] , and the 




Fig. 1. Example of a 55" x 55" SWAN field: SBSF 24. 
The bright source in the center is the guide star, and the 
circles are the extended objects detected by SExtractor 
(SExtractor stellarity index SSI < 0.9); the squares are 
point sources (SSI > 0.9). A ghost of the bright guide star 
is marked with a cross. North is up and east is right. 



noise measured in the resulting coadded image rescaled 
to 1 sec integration time in [6] . The mean airmass is re- 
ported in [7]. The Strehl ratio, estimated from a series of 
short exposures through a narrow band filter taken before 
and/or after the science exposures in order to monitor the 
on-axis PSF, is given in column [8]. This is calculated from 
the ratio of the maximum pixel to the total flux, and in- 
cludes a correction for the offset of the PSF's centroid from 
the center of a pixel; this can be considerable (typically 
adding 5-10% to the Strehl ratio for the data here) due to 
the large 0.054" size of the pixels. The number of bright 
point sources in each field used to evaluate the isoplanatic 
angle at 2.2 fim, fitting the variation of their Strehl ratio 
in our Kg images (see section ISJ , is reported in [9] , and 
the resulting isoplanatic angle in column [10]. 

4. Data reduction 

The data obtained were reduced using PC-IRAF (ver- 
sion 2.11.3) together with some scripts in IDL (ver- 
sion 6.0). The presence of a bright star in the center of a 
field less than 1' across made the data reduction more com- 
plex than usual, requiring extra steps to compensate. An 
initial estimate of the sky background was made from the 
target frames after masking all bright objects in the fields. 
Each target frame then had the sky subtracted, was flat 
fielded, had any residual constant background removed, 
and hot pixels corrected. A mask that included dead pix- 
els and bad regions was then applied to each frame. In 
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Name R.A. DEC. Obs. At o-imago'' mean Strehl N. of 6*0" 

(J2000.0) (J2000.0) Date" (min) (e" s"^) airmass % Stars (") 
(1) (2) (3) (4) (5) (6) (7) (8) (9) (10) 



SBSF02 


00 


44 


31. 


.88 


-29 


52 


30. 


.3 


07. 


.09, 


.04 


SBSF03 


00 


45 


20. 


.62 


-29 


56 


46. 


.0 


08. 


.09, 


.04 


SBSF04 


00 


45 


28. 


.05 


-29 


31 


40. 


.1 


09. 


.12, 


.04 


SBSF06 


00 


50 


34. 


.70 


-29 


26 


32. 


.0 


09. 


.09, 


.04 


SBSF08 


00 


52 


18. 


.88 


-29 


27 


17. 


.8 


12. 


.09, 


.04 


SBSF 14 


06 


07 


06. 


.34 


-13 


13 


37. 


.1 


15. 


.12, 


.02 


SBSF 15 


08 


44 


00. 


.22 


-16 


34 


01. 


.1 


17. 


.12, 


.02 


SBSF 16 


09 


14 


52. 


.77 


-19 


26 


17. 


.0 


18. 


.12, 


.02 


SBSF 17 


09 


47 


44. 


.79 


—21 


37 


12. 


.7 


20. 


.03, 


.03 


SBSF 18 


09 


49 


46. 


.99 


—21 


45 


13. 


.3 


17. 


.12, 


.02 


SBSF 24 


10 


40 


26. 


.20 


-30 


00 


36. 


.5 


21. 


.03, 


.03 


SBSF 27 


12 


55 


37. 


.48 


-31 


42 


41. 


.3 


11. 


.04, 


.04 


SBSF 28 


12 


56 


14. 


.14 


-42 


09 


10. 


.9 


11. 


.04, 


.04 


SBSF 34 


13 


46 


25. 


.24 


-31 


45 


47. 


.5 


11. 


.04, 


.04 


SBSF 36 


22 


14 


36. 


.74 


-28 


25 


31. 


.6 


05. 


.09, 


.03 


SBSF 37 


22 


43 


04. 


.43 


-39 


49 


29. 


.3 


06. 


.09, 


.03 


SBSF 38 


22 


47 


06. 


.77 


-40 


10 


01. 


.3 


05. 


.09, 


.03 


SBSF 39 


22 


49 


34. 


.23 


-39 


33 


05. 


.3 


15. 


.06, 


.03 


SBSF 40 


22 


49 


49. 


.32 


-39 


53 


15. 


.0 


12. 


.06, 


.03 


SBSF 41 


22 


50 


21. 


.28 


-40 


07 


38. 


.6 


14. 


.06, 


.03 


SBSF 42 


23 


29 


55. 


.77 


-18 


35 


54. 


.1 


16. 


.06, 


.03 



54 


0.29 


1.08 




2 


5.90 


54 


0.29 


1.24 




2 


11.20 


68 


0.28 


1.22 


33 


2 


10.65 


54 


0.33 


1.17 


24 





[12.70] 


56 


0.32 


1.09 


42 


1 


12.00 


60 


0.22 


1.20 




4 


11.95 


60 


0.25 


1.12 


-■ ■ 


10 


21.78 


50 


0.25 


1.07 




1 


12.84 


44 


0.28 


1.05 


35 


2 


10.61 


40 


0.30 


1.06 




7 


21.18 


60 


0.24 


1.02 




8 


11.77 


44 


0.30 


1.07 


35 


12 


17.85 


44 


0.27 


1.26 


42 


2 


9.94 


44 


0.28 


1.36 


28 


2 


4.89 


60 


0.23 


1.09 


35 


2 


13.25 


60 


0.23 


1.10 


34 





[12.70] 


60 


0.22 


1.04 


31 


2 


10.68 


60 


0.24 


1.04 


22 


1 


10.00 


48 


0.34 


1.04 


10 





12.70 


60 


0.26 


1.04 


33 


3 


19.72 


60 


0.24 


1.03 


35 





[12.70] 



Table 1. Observational parameters and AO performances for NACO observations of SWAN fields. See the text for a 
full description of the entries. ° CONICA was fitted with a new detector in June 2004.^ The noise is that measured in the 
resulting co-added image, scaled to a 1 sec integration. Its statistical properties closely follow a Gaussian distribution 
with additional weak wings. ^ '0o' refers to the isoplanatic angle in band as measured fitting the variation of the 
Strehl ratio of the point sources in the fields as described in the text. 



order to correct for over-subtraction from very extended 
faint scattering (and/or emission) around bright objects, 
a surface was fit to each frame (ignoring regions in the ob- 
ject mask) and subtracted. The frames were then aligned 
with sub-pixel accuracy using up to several conspicuous 
isolated objects in the field, and averaged after rejecting 
high and low pixels at each point according to an esti- 
mated variance. This initial combined frame was used to 
generate a new object mask, and the entire data reduc- 
tion process was repeated, yielding a new combined frame 
with much less over-subtraction. In a final step, the ob- 
jects were once more masked out and a surface fitted to 
the background, and this was subtracted to produce the 
final image. 

The sky is estimated by dithering, i.e., slightly mov- 
ing the telescope between different frames so that different 
pixels sample different parts of the sky. In SWAN the off- 
sets were chosen semi-randomly within a 7" box, due to 
the limited NACO field of view. Therefore, even if great 
care is used to produce the sky frames, the sky around 
objects larger than ~ 3", i.e., for the very bright guide 
star and for galaxies with effective radius i?e > 1", may 
be overestimated, producing a self-subtraction of some 
galaxy flux. This effect can produce fainter magnitudes 
and smaller dimensions for such bright and large objects. 



although these constitute less than 2% of the total sam- 
ple in our fields. However, in section we will see that 
this effect introduces some systematic uncertainties in the 
size-magnitude relation for large galaxies. 

5. Source detection 

In each reduced SWAN field, sources were detected using 
SExtractor (Berlin & Arnouts 119961) . with the appropri- 
ate parameters optimized for compact sources, set to pro- 
vide a positive detection for objects brighter than 1.5 cr 
per pixel over an area of more than 3 pixels. To improve 
the detection of faint sources we used a Gaussian filter 
{a — 1.5 pixels) to smooth the image. False detections 
at the noisy borders of the mosaic and on the spikes and 
the ghost of the bright guide star were removed. For the 
former, a mask that indicated the fraction of the total 
integration time spent on each pixel was used; objects de- 
tected in pixels below a specified threshold were rejected. 
For the latter, appropriate object masks were created. Our 
algorithm deliberately does not push the detection to the 
faintest possible limit, as we are more interested in the 
high resolution AO morphologies of the brighter sources 
than in the deepest possible number counts. For this rea- 
son, our counts (see Section IHJ are not significantly con- 
taminated by spurious detections due to noise. The total 
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coverage above the detection thresholds of the 21 fields is 
15.3 arcmin^, within which a total of 495 sources are de- 
tected down to a magnitude of Kg ^ 23.5 (-f^AB '~ 25.3, 
see section (HJ. 

6. Morphological fitting 

The morphological parameters of the detected galaxies 
were derived using GALFIT (Peng et al. I21)U2|I . a widely 
used software package that fits a two-dimensional image 
of a galaxy and/or a point source with one or more ana- 
lytic functions that have been convolved with a model of 
the PSF. To fit the galaxies in our SWAN fields we used 
a single Sersic (^68) profile, 

I{R) = I{Re) X exp(-&„ X [(i?/i?e)'/" - 1]) (1) 

where Re is the effective radius that encloses half of the 
light, n is the Sersic index and b„ is a constant that varies 
with n, chosen so that Re corresponds to the half-light 
radius. 

GALFIT needs as an input a PSF to convolve the 
Sersic profile model. We used the off-axis AO PSF model 
presented in Paper I, which is optimized for wide-field and 
high Galactic latitude observations. The off-axis PSF is 
determined by convolving the on-axis PSF in each of the 
fields with an elliptical Gaussian kernel elongated towards 
the guide star. The FWHM of the kernel depends on the 
distance from the guide star and on the isoplanatic angle 
of the field. We therefore derived the isoplanatic angle for 
each field fitting the variation of the Strehl ratio of the 
point sources across the field as described in Paper I. The 
obtained isoplanatic angle along with the number of point 
sources used in the fit are reported in Table The de- 
rived isoplanatic angles for the 21 fields range from 4.9" 
to 21.8". In four of the fields no bright point source was 
available except the guide star, and therefore the average 
isoplanatic angle for the other fields (12.7") was assumed. 

Initial guesses for GALFIT model parameters were ob- 
tained from the SExtractor source catalogs. Lacking an 
estimate of the Sersic index n in the SExtractor catalogs, 
we used n = 2 for all the galaxies in the first iteration. 
Each galaxy was fitted twice, using as first guesses for the 
second iteration the output parameters of the first itera- 
tion. Roughly 16% of the detected galaxies could not be 
fitted satisfactorily with a single component, but required 
simultaneous fits with very close companions or multiple- 
component fits. These can be divided in two categories. 
9% of the total are interacting galaxies or very close pairs, 
where the overlap of the isophotes from different objects 
required a simultaneous fit. A further 7% of the total are 
galaxies for which a single-component Sersic profile was 
not sufficient to fit the light profile, leaving significant 
residuals in the subtraction. Half of these two-component 
galaxies were re-fit using a disk component and an ellip- 
tical bulge, while the other half were re-fit by adding a 
central point source to the Sersic component. 

As we have shown by the detailed simulations in Paper 
I, the morphological parameters of the galaxies detected 




0.4 - ? ' 
0.2 - " " ' 



L^i^^i - — 

a 4 6 a 10 

11 

Fig. 2. The distribution of the axis ratios b/a of the 
SWAN galaxies fitted by GALFIT with < 2 as a func- 
tion of their Sersic index n. As expected, while late-type 
galaxies (n < 2) are observed at random inclinations with 
respect to the plane of the sky, and therefore at every 
b/a, early-type galaxies (n > 2) are not observed with 
b/a < 0.4. 



at the depths of our images can be derived with low un- 
certainties up to Ks ^ 20.5, while for fainter objects the 
uncertainties grow as a function of the magnitude. In ad- 
dition, we recall that it is possible to set a threshold 
of n = 2 on the Sersic index that can discriminate be- 
tween late-type galaxies {n < 2) and early-type galaxies 
(n > 2). The results of our simulation are confirmed e.g. by 
Ravindranath et al. H20U4|I . who used GALFIT to fit sin- 
gle Sersic profiles to a sample of nearby galaxies of known 
morphology from the Frei et al. H1996|l sample, after artifi- 
cially redshifting them to z = 0.5 and z = 1.0. They found 
that n = 2 is the appropriate threshold to separate disk- 
dominated galaxies from bulge-dominated ones, even in 
the presence of morphological complexities such as dust, 
star-forming regions, etc. (Ravindranath et al. l2004|l . 

Of the 383 galaxies detected to Kg ^ 23.5 (see sec- 
tion [T] for a discussion of the 112 stars), 214 were classi- 
fied as late-type and 169 as early-type. The sources fit- 
ted with multiple components are classified according to 
the Sersic component providing the higher flux contribu- 
tion. The galaxies are divided in these two subclasses for 
the following analysis, with an average contamination be- 
tween the two subclasses of less than 10% up to Ks = 21 
(Paper I). In order to quantify the morphological fit qual- 
ity, we used the xt calculated by GALFIT. We classified 
as well-fit the 315 galaxies with < 2 (167 late-type 
and 148 early- type), while the other fits were considered 
less reliable and are not considered when computing the 
size-magnitude relation of the galaxies in the SWAN fields 
(although they are included in the number counts). As 
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an additional check of our late/early- type separation, we 
show in Fig.[51the distribution of the axis ratios h/a of the 
galaxies with ^ 2 as a function of Sersic index n. As 
expected, while the late-type galaxies are observed at ran- 
dom inclinations with respect to the plane of the sky, and 
therefore at every h/a, early-type galaxies are not observed 
with b/a < 0.4 (e.g. Lambas et al. I1992|l . This confirms 
that our morphological classification of early and late type 
galaxies based on the Sersic index n produces reliable re- 
sults. 

While the redshifts of these objects are presently un- 
known, the magnitudc-redshift relation of Cowie et al. 
ifD^ and the K20 survey (Cimatti et al. IMI^ indicate 
that at X = 20 the median redshift is 2 ~ 0.8 — 1. At this 
redshift, our spatial resolution of 0.1", which also corre- 
sponds to the smallest effective radius bin, is equivalent to 
only 500 pc for typical cosmologies, hinting at the exciting 
potential of this work. 

7. Star-galaxy separation 

The separation of Galactic foreground stars from the field 
galaxies is a critical step for avoiding star contamina- 
tion in our galaxy catalogue. We classified as stars all 58 
sources detected in the NACO images with SExtractor 
stellarity index SSI > 0.9. The SExtractor classification 
should be treated with caution since it assumes a con- 
stant PSF across each field, and elongated sources are 
more likely classified as galaxies. However, all the objects 
classified as stars by SExtractor lie on an upper envelope 
in a Strehl versus radial distance plot, i.e., they have the 
highest Strehl ratio among the sources at the same dis- 
tance from the guide star, supporting their classification 
as point sources. It remains possible that some stars are 
not classified as point sources by SExtractor, due to the 
limited isoplanatic AO patch and their resulting elongated 
shape. We therefore also classified as stars all the very 
compact sources fitted by GALFIT with <0M". This 
is supported by simulations in which we fitted true fidu- 
cial point sources in the SWAN fields, rescaled to several 
magnitudes, with GALFIT Sersic profiles and obtained 
very compact effective radii Re < 0.01" and high Sersic 
indexes. For very bright and elongated PSFs, the fitted 
Re can still be as large as ~ 0.2", due to the higher sig- 
nal in the halos of the PSF that may not be perfectly 
reproduced by the PSF model. We therefore include in 
the star catalogue all the sources with Ks < 18.5 (in or- 
der to have sufficiently high S/N) that are classified as 
stars by SExtractor in our SOFI seeing limited images of 
the SWAN fields. All the objects classified as stars in the 
seeing-limited images proved to be compact in the AO- 
corrected ones as well, even if elongated, with all having 
Re < 0.16" as fitted by GALFIT using the appropriate 
local PSFs for convolution. 

We have a total of 112 stars in the 21 SWAN fields an- 
alyzed. To assess the robustness of the star /galaxy classifi- 
cation, the star counts were compared with the predictions 
of the Bahcall et al. ((1980|) galaxy model, which provides 
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Fig. 3. Number of stars in the SWAN fields as a function 
of Galactic latitude b up to A's — 22, compared with the 
predictions of the Galaxy model of Bahcall et al. (1980). 
The observed and predicted stars number counts are in 
very good agreement for all latitudes except the lowest 
latitude bin (|6| < 20°), where the Galactic model is less 
accurate due to the high variability between adjacent lines 
of sight. 



the star counts as a function of the field's Galactic longi- 
tude and latitude. As the model provides the number of 
stars brighter than a certain limiting magnitude in the V 
band, we convert the V magnitude into a Kg magnitude 
using an average color derived from the _fC-band counts at 
the Galactic pole provided by Hutchings et al. (2002). In 
Fig. 13 we show the number of stars in the SWAN fields 
as a function of Galactic latitude b up to ^ 22, which 
corresponds to the limit where we are 100% complete for 
point sources (see Fig. O. It can be seen that the ob- 
served and predicted stellar number counts are in very 
good agreement for all latitudes except the lowest latitude 
bin {\b\ < 20°), where the Galactic model is less accurate 
due to the high variability between adjacent lines of sight. 
However, the total excess of selected stars with respect to 
the model predictions is only 18 sources, i.e., small com- 
pared to the total catalogue of 383 galaxies. Therefore, 
even if some compact galaxies in these fields were erro- 
neously classified as stars, they represent less than 5% of 
the sample. 

8. Completeness correction and number counts 

The probability of detecting a source in one of our images 
depends on five different parameters: 

1. The total integrated magnitude 

2. The Sersic index n, as for a given magnitude more con- 
centrated objects (i.e., early-fike galaxies with n > 2) 
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Fig. 4. The left panel shovirs the variation of the detection probability for a late-type galaxy in SWAN as a function 
of the magnitude and the effective radius Re- The probability is the average for all 21 observed fields, and assumes a 
distance from the guide star 1 < 9/9f) < 2. The right panel shows the same for early-type galaxies. 



are more easily detected than exponential-like galaxies 
(n < 2) with lower concentration. 

3. The effective radius Re- As before, more compact 
sources are more easily detected. 

4. The SWAN field in which the source was observed. 
The integration time and therefore the signal/noise ra- 
tio is different in different fields. In addition the over- 
all AO correction is different in each observation, as 
is indicated by the different on-axis Strehl ratios (see 
Tabled). 

5. The distance from the guide star O/Oq, as the degree of 
correction of the AO system depends strongly on this 
parameter (see, e.g.. Paper I). 

The last two parameters are due to the distinctive at- 
tributes of our survey, which makes use of several different 
fields (4) and of AO (4,5). 

In order to derive the detection probability for each 
combination of these five parameters, we ran several sim- 
ulations, adding a total of 65,000 simulated galaxy profiles 
with known parameters - matched to the ones of the ob- 
served galaxies - to the original SWAN fields at random 
locations and tried to recover them running SExtractor 
again. We used extended sources to evaluate the complete- 
ness correction, as this produces results that are quite 
different from those inferred using point sources alone, 
especially at this resolution. SExtractor was used with 
the same parameters used in the science source detection. 
We used the Sersic index n = 1 for late-type galaxies 
and n = 4 for early- type galaxies. For both types the 
effective radius i?e ranged from 0.1"to 1.0". The galaxy 
profiles were convolved with real NACO PSFs extracted 
from point sources in our data lying at different distances 
from the guide star, in order to simulate the effect of the 
AO correction. The simulated galaxies have magnitudes 
ranging between = 19, where we are 100% complete 
for every combination of the other four parameters, to 
Ks = 23.5. We consider three different regimes for the 




Mag(Ks) 

Fig. 5. Comparison between the completeness for point 
sources and for extended sources for the SWAN fields. 
The completeness for point sources (triangles, dashed 
line) was evaluated adding 100 true NACO point sources 
{0/9o — 1.5) for each magnitude to each field and then 
averaging over all fields. The completeness for extended 
sources (circles, solid line) is the average over all the fields 
for both late and early-type with R^ = 0.3", i.e., the mean 
for all the detected sources in SWAN, at the same distance 
from the guide star used for the point sources. The error- 
bars show the variance for the 21 different fields. 



detection probability as a function of the distance from 
the guide star: 6/00 < 1, 1 < 9/9q < 2 and 9/00 > 2. 
We used point sources at 9/9o = 0.9, 1.5, and 2.8 respec- 
tively for the three regimes as references for the PSF in 
the simulated galaxies. 
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Using this approach, we can derive the detection prob- 
abihty for a galaxy of known magnitude, Re, Sersic index, 
and distance from the guide star in a particular field. By 
way of example, the histograms of the detection probabil- 
ity averaged over all 21 fields as a function of magnitude 
and of effective radius Re for late and early-type galaxies 
with 1 < O/Oq < 2 are shown in Fig. 0| It is clear from 
comparing the panels how much more sensitive high res- 
olution images are to more core-concentrated sources like 
the elliptical galaxies. 

The detection probability can be used to correct the 
number counts using the observed galaxy population as a 
starting point. From our simulations we derived the de- 
tection probability Pdctcct for each detected galaxy in the 
survey, using the measured Re, magnitude, and Sersic in- 
dex from GALFIT fitting (see section EJ, along with the 
position of the galaxy in the field. Each galaxy is then 
regarded in the completeness-corrected number counts as 
l/Pdetoct sources at its magnitude, so that, for example, 
a galaxy with Pdotcct = 0.80 counts as 1.25 galaxies once 
the correction is applied. 

In Fig. |S1 we show the average completeness over all 
the fields for both point sources and extended objects as a 
function of magnitude. The completeness for point sources 
was derived by adding (100 times) to each field a true 
NACO point source with rescaled flux. The point source 
was at a distance 9/9o = 1.5 from the guide star. The com- 
pleteness for extended objects is the average between that 
of late-type and of early-type galaxies over all the fields, 
using the same NACO point source PSF to convolve the 
simulated galaxy profiles. The effective radius was fixed at 
the average for the detected SWAN sources {Re = 0.3"). 
Obviously the correction derived using only point sources 
is much smaller than the one derived as described above, 
with the number of sources in the range 20.5 < Ks < 22 
(where no correction would be applied in the point-source 
case) being particularly underestimated. 

The corrected number counts, obtained using the de- 
tection probabilities of the observed SWAN sources as 
weights, are shown in Fig. |^ At brighter magnitudes 
(Ks < 16), an excess is present in our number counts 
with respect to others in the literature. This is due to a 
selection bias, as some of the fields were chosen to have an 
excess of bright galaxies (see Baker et al. 2003). At fainter 
magnitudes, the points at Ks > 23 are no longer reliable, 
as the completeness correction adds more than 90% of the 
sources. We derive a slope dlog {N)/dM = 0.26 ± 0.01 in 
the range 16 < Kg < 22. Our corrected number counts are 
in good agreement with those found by other authors in 
the literature (see Fig.|HJl. This result, together with what 
was found in Paper I, shows once more that we are able 
to account for the biases introduced by the variable AO 
PSF and that the data can therefore be reliably used for 
further analysis. 
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Table 2. Differential number counts in the SWAN fields. 
The raw number of detected galaxies is reported in (2). 
In (3) the corrected number counts (N mag~^ deg~^) for 
the whole sample are shown, while (4) and (5) separate 
late- type and early- type counts, respectively. 




O Huang et al. 97 
9 Gardner et al. 96 
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Fig. 6. Kg corrected (solid circles) and uncorrected (solid 
triangles) number counts from SWAN, compared with 
other if-band surveys. The points at Kg > 23 are not re- 
liable as the completeness correction is adding more than 
90% of the sources. The excess at bright magnitudes is 
due to a selection bias, as some of the fields were se- 
lected to contain more bright galaxies (Baker et al. 2003). 
The solid line is the best fitting power-law in the range 
16 < Kg < 22, with a slope d\og{N)/dM = 0.26. The 
error bars show the Poissonian errors. 



9. Comparison with galaxy evolution models 

Most theoretical models of galaxy formation and evolu- 
tion can be roughly divided into two broad categories: 
the so-called "backwards" approach and the "ab initio" 
approach. In the former approach (Tinslev fl98()l Yoshii & 
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Takahara l 19881 Fukugita et al. ll99l)l Rocca-Volmerange & 
Guiderdoni nMH Yoshii & Peterson [T^ Pozzetti et al. 
nM^iroUSl Jimenez & Kashlinsky 1999 Totani & Yoshii 
I2UUUI Totani et al. I2UU1|I . the evolution is probed back- 
wards into the past to predict observables such as galaxy 
counts and redshift distributions. The local properties of 
galaxies, like multi-band colors and chemical properties, 
are used to construct a reasonable model of the star for- 
mation history and luminosity evolution of galaxies based 
on the stellar population synthesis method. The formation 
epoch and merging history of galaxies, however, cannot 
be predicted in this framework, as they are introduced as 
phenomenological parameters that can be inferred from 
comparison with observational data. 

In the latter approach (Kauffmann et al. I199HI Cole 
et al.TW 'MiD', Somerville & Primack lTMUl Nagashima 
et al. 2005), on the other hand, the formation epoch and 
merging history of galaxies are predicted by the standard 
theory of structure formation in the CDM universe. In 
these models the local and high redshift properties of the 
galaxies such as the luminosity function, mass and size dis- 
tribution, are outputs of the model that can be compared 
with observations. However, although the formation and 
evolution of dark matter halos are considered to be rather 
well understood, our knowledge about baryonic processes 
such as star formation, supernova feedback, and galaxy 
merging is still very poor, and a number of phenomeno- 
logical parameters must be taken into account, making 
the comparison of the modeled and observed data more 
complex. Here we compare the galaxy counts in SWAN 
and the size-magnitude relation of the detected galaxies 
with representative results of these two radically different 
approaches. 

9.1. The galaxy evolution models 

The first model used is a "backwards" pure luminosity evo- 
lution (PLE) model developed by Totani & Yoshii (lUUb] 
and Totani et al. H2001|l . based on the present-day proper- 
ties of galaxies and their observed luminosity function. It 
evolves a system's luminosity and spectral energy distribu- 
tion evolution backward in time using a standard galaxy 
evolution model in which star formation is tuned to repro- 
duce galaxies' present-day colors and chemical properties 
(Arimoto & Yoshii [TM71 Arimoto et al. lTM^ . The model 
includes the effects of both internal dust obscuration and 
intergalactic HI absorption, and it does not incorporate 
galaxy mergers; therefore the galaxy sizes and comoving 
number density do not evolve. The number density of 
galaxies is normalized at z = using the local i?-band 
luminosity function of galaxies, while the relation of the 
present B luminosity and effective radius Re is determined 
from power-law fits to the empirical relation observed for 
local galaxies of different types (Bender et al. 119921 Impey 
et al. I1996|l . Galaxies are in fact classified into six mor- 
phological types: three of them (Sab, Sbc, and Scd) are 
assigned to spiral galaxies, while an Sdm model is used 



for irregular galaxies. Following Totani et al. H2001|l . we 
divided the E/SO galaxies into distinct population of gi- 
ant ellipticals (gE, Mb S "1"^) ^-^d dwarf ellipticals (dE, 
Mb ^ —17). It is known that these are two distinct popu- 
lations, showing different luminosity profiles (the r^/'' law 
for giants and exponential for dwarfs; see Barazza et al. 
I2005|) . different luminosity-size relations, luminosity func- 
tions and different physical processes that govern the evo- 
lution of each type (see, e.g., Ferguson & Binggeli 119941 
and references therein; Ilbert et al. 120061 for evidence of 
two different populations up to z ~ 1.2). 

In the Kg band, the critical separation magnitude 
{Mb — —17) corresponds to Mk^ ~ —21 for the typical 
color of elliptical galaxies. Since the contribution of early- 
type galaxies is more significant in the near-infrared than 
in the optical, it is important to take into account such 
distinct populations of elliptical galaxies in predicting the 
Ks counts. 

In addition, we compare the derived properties of the 
SWAN galaxies with the predictions of the "a6 initio" 
Numerical Galaxy Catalog (NuGC) of Nagashima et al. 
I|2005|l . which is based on a semi-analytic (SA) model 
of galaxy formation combined with high-resolution A'^- 
body simulations in a ACDM cosmological framework. 
The model includes several essential ingredients for galaxy 
formation, such as the merging histories of dark halos 
directly derived from A^-body simulations, radiative gas 
cooling, star formation, supernova feedback, mergers of 
galaxies, population synthesis, and extinction by internal 
dust and intervening HI clouds. The high resolution used 
for the simulations, with a minimum mass for dark halos 
of 3 X 10^ Mq, is sufficient to resolve their effective Jeans 
mass. 

It was shown by Nagashima et al. H2()()5|l that this 
model is in reasonable agreement with several observa- 
tional results, like the luminosity functions in B and K 
bands, the H I mass function, the size-magnitude relations 
for local spirals and elliptical galaxies, the TuUy-Fisher 
and Faber-Jackson relations at z = 0, faint galaxy number 
counts in BVRi'z' bands, and the cosmic star formation 
history at high redshift. In addition, the model is able to 
reproduce the distribution of {R — K)ab colors with red- 
shift observed in GOODS (Somerville et al. lMIHl . includ- 
ing extremely red ((i? — Ks)ab ~ 5) galaxies that other 
semi-analytic treatments have trouble accounting for. In 
summary, the model is able to reproduce several observa- 
tional results for local and high-redshift galaxies, not just 
those that were used to tune the model parameters. 

9.2. Addressing cosmic variance 

The uncertainties in galaxy number counts include contri- 
butions from Poisson errors and from the so-called "cosmic 
variance" , due to the fact that galaxies are strongly clus- 
tered and thus distributed in overdensities and large voids 
on the sky. Therefore, we have to take into account the 
corresponding effects on the relative normalizations of the 
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Fig. 7. Comparison of total number counts for all galaxies (left panel), and of the mean Re as a function of magnitude 
for those sources with < 2 in the GALFIT fit {right panel), with the PLE model (solid line) and the hierarchical 
model (dashed line) predictions. In the number counts, the points at Kg < 15 shows an excess due to a selection bias, 
as some fields were selected to contain more bright galaxies. Counts from other surveys in the literature for Kg < 16 
were therefore plotted for comparison to the model in this range (see Fig. 1^1 for the references of the data points). 
The error bars on the number counts are the Poisson error, while in the size-magnitude relation they represent the 
standard error on the mean. 



predicted and observed counts in order to make a fair com- 
parison. According to Daddi et al. H2000|l . the RMS fluc- 
tuations atot of numbers counts around their mean mean 
value, taking into account both the Poisson error and the 
cosmic variance, are given by 



al,^X-il + X AC) 



(2) 



where X are the total number counts, A is the clustering 
amplitude (^ ~ 1.6 x 10"^ for the Daddi et al. PTHUjl 
if -selected sample), and C is a factor that depends on the 
field area and can be approximated by C = 58 area"'^'^ 
for an area expressed in arcmin^. In our case, as we ob- 
serve galaxies in TV = 21 different fields of the same area, 
thus reducing the clustering uncertainty, equation [5] can 
be written as 



1 



Xt. 



N 



'-AC 



(3) 



where N is the number of fields, Xtot is the total number 
of sources detected in all the fields, and C corresponds 
to the area of a single field. Therefore we derive that the 
relative uncertainty on the number counts is given by 



<7tot 



1 



AC 



= 0.08 



(4) 



Xtot V Xtot N 

for the SWAN fields, while the contribution from Poisson 
statistics would only be of the order of 5%. 

We expect that the predictions of any successful model 
should fit the observed SWAN counts within a discrepancy 
of this order of magnitude. In good agreement with these 
expectations, we find that a correction of 4% produces 



the best match with the total number counts in the PLE 
model, while a correction of 1% provides the best match 
to the hierarchical model. The model predictions discussed 
in the following sections have been renormalized accord- 
ingly, i.e., PLE and hierarchical model normalizations are 
multiplied by 1.04 and 1.01 respectively. 

9.3. Comparison of the SWAN data with the model 
predictions 

The predictions of the PLE model for the galaxy counts 
and galaxy size as a function of the Kg magnitude were 
compared with the number counts and effective radii 
Re observed in the SWAN images. We are assuming for 
the PLE model Hq = 70 km s-iMpc"\ = 0.27, 
r^A = 73, and a formation redshift zf — 5 for all galaxy 
types (Totani et al. I2001|l . The comparison between the 
PLE model and the total completeness corrected number 
counts is shown in Fig. [7^. As explained in section [SJ the 
points at Kg < 15 show an excess due to a selection bias, as 
some fields were selected to contain more bright galaxies. 
Counts from other surveys in the literature for Kg < 16 
were therefore plotted for comparison to the model in this 
range, and good agreement is found between the SWAN 
galaxy counts and the PLE predictions. 

Figure[7|D shows the average effective radius (log(i?e)) 
of the galaxies with the most reliable morphological fit- 
ting, i.e., those fit by GALFIT with xl < 2- The average 
must take into account the selection effects due to the dif- 
ferent detection probabilities of the galaxies. We therefore 
weighted each galaxy using its detection probability as de- 
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Fig. 8. Comparison of the SWAN counts for exponential profile galaxies {n < 2, left panel) and early-type galaxies 
(n > 2, right panel) with the PLE model (solid line) and hierarchical model (dashed line) predictions. The open circles 
are not reliable points, as explained in the legend of Fig. 



rived in section |H| The error bars show the standard error 
on the mean. The observed data points are compared with 
the predictions of the PLE model, which manifests a slight 
overprediction of the galaxies' Re - This effect is mainly due 
to the late- type galaxy population (see Fig.llOfl. for which 
there might be hint of an increase in size, and will be dis- 
cussed in section 19.41 Our results confirm the finding of 
Totani et al. (2001) and Minowa et al. (2005), who found 
in the Subaru Deep Field and Subaru Super Deep Field 
that a PLE model with no number or size evolution gives 
the best fit to their X-selected sample's number counts 
and isophotal area distribution. 

The NuGC hierarchical model is also compared with 
the total galaxy counts and distribution for SWAN 
in Fig. [7| Within the observational uncertainties of the 
shape of the observed luminosity functions, Nagashima 
et al. H2()()5|l adopted two different models, characterized 
by two different supernova feedback regimes- their strong 
supernova feedback (SSFB) model and weak supernova 
feedback (WSFB) models. Comparisons with the total 
faint number counts and isophotal area distribution for 
A'-band selected galaxies in the Subaru Deep Field, and 
with redshift distributions for faint galaxies, showed that 
the SSFB model is in better agreement with the prop- 
erties of the if-selected sample (Nagashima et al. .2002i 
Nagashima et al. I2005|l . although the predicted counts 
were overestimated for K > 23. We therefore compare the 
properties of the SWAN galaxies with the SSFB model 
predictions only in the following. A ACDM cosmology is 
used for the hierarchical model, with fl„i = 0.3, JIa = 0.7 
and Hq — 70kms~^ Mpc~^. As found by Nagashima et 
al. H2005|l . the model is in good agreement with the total 
number counts data, and matches the Re distribution in 
SWAN as well as the PLE model. 



9.4. Morphological type dependent comparison 

In addition to the total number counts and size-magnitude 
relation, our high-resolution AO morphological classifica- 
tion of the SWAN galaxies allows us to assess the predic- 
tions of the models for the counts and sizes of the late 
type and early type galaxies separately. This is one of the 
first times such a comparison has been done in the near- 
IR, as both AO observations and accurate PSF modeling 
are needed to obtain reliable morphological classification 
of faint field galaxies at these wavelengths. We are there- 
fore able to compare our observational data with untested 
predictions of the two models. 

In Fig. IH^L, the PLE model predictions for the number 
counts of all galaxies with exponential profiles (spirals, 
irregulars and dwarf ellipticals) are compared with the 
observations for galaxies with Sersic index n < 2 according 
to GALFIT. We find good agreement between model and 
data for the number counts, as before. A very similar result 
is found using the hierarchical model prediction for late- 
type galaxies. 

Fig-IHt' shows the predictions of both models for early- 
type galaxies, compared with the observations for n > 2 
galaxies in SWAN. In the SWAN data, the elliptical counts 
are much flatter than the late-type counts, showing a 
plateau for i^s > 20. A much flatter slope in the early- type 
galaxies number counts with respect to the late-types was 
found also by Teplitz et al. (HMHll, using HST NICMOS 
observations in the H band, and in deep optical observa- 
tions (e.g. Abraham et al. llH96|l . The adopted PLE model 
is able to convincingly reproduce the plateau observed in 
the counts for i^s > 20; a similar behavior is predicted by 
other PLE models (see, e.g., Pozzetti et al. I1996|l . This 
plateau is produced in the model by a combination of two 
effects. First, the luminosity function of the gE population 
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Fig. 9. Comparison of the total SWAN number counts 
with the PLE model predictions. The contributions of dif- 
ferent galaxy types are shown as different thin lines, while 
the prediction for the total population of galaxies is shown 
as a solid line. The large open circles are not reliable, as 
explained in the caption of Fig. [7| 

is bell-like (see, e.g., Totani et al. I2()()l|l . and the number 
of faint gEs decreases rapidly with decreasing luminosity. 
Second, in the PLE model beyond z > 1.5 giant ellipti- 
cals are very faint, due to heavy extinction in the model 
(r > 10), as described in Totani & Yoshii H2()()();i . As a 
result, for Kg > 20 (corresponding to an L* galaxy at 
z = 1.5), going to fainter magnitudes does not correspond 
to an increase of the sampled volume. Instead, beyond 
Ks = 20, the model predicts we should begin to miss the 
dusty high-redshift progenitors of today's ellipticals, con- 
sistent with the plateau observed in the SWAN data. A 
scenario in which massive z > 1.5 ellipticals are highly 
obscured by dust during their starburst phase, and there- 
fore produce the plateau observed in our if-band number 
counts, is consistent with the detection of very luminous, 
highly obscured submillimeter galaxies at high redshift 
(Blain et al. 120021 and references therein). In addition, 
galaxies with unusually red IR colors that have been mea- 
sured in deep in near-IR observations can be explained 
as primordial elliptical galaxies that are reddened by dust 
and still in the starburst phase of their formation at z > 3 
(e.g., Totani et al. lMITjl . 

In contrast to the success of the PLE model, the hier- 
archical considerably underpredicts at bright magnitudes 
(Kg < 20) and overpredicts at fainter magnitudes the ob- 
served number counts. In particular, the observed plateau 
in the early-type counts, which was very well reproduced 
in the PLE model, is not expected at all in the hierar- 
chical model predictions. This disagreement implies that 
the processes that produce an elliptical galaxy, in at least 
this particular hierarchical model, are not adequate to de- 
scribe reality. In the model, an elliptical galaxy is formed 



through a major merger, i.e., a merger with mass ratio 
/ — mi/m2 > 0.3, in which it is assumed that all the cold 
gas turns into stars and hot gas, and all the stars populate 
the bulge of a new galaxy. Although it may be possible 
to increase the number of bright ellipticals by changing 
the model parameter that regulates the mass ratio distin- 
guishing major from minor mergers, it seems harder to 
decrease the model's number of A's > 20 ellipticals to the 
level observed in SWAN (Nagashima private communica- 
tion). In this case no separation is possible between the 
gE and dE populations, as all the major mergers produce 
galaxies with a de Vaucouleurs profile. 

We note that misclassification of galaxies between the 
two categories of early and late-type is not expected to 
strongly affect these conclusions. We expect only ^ 10% 
of late-type to be misclassified as early-type and ~ 10% of 
early- type to be misclassified as late- type at it's = 21 (see 
Paper I). Since at faint magnitudes the number counts 
of spirals are ~ 10 times higher than those of ellipticals, 
it is more likely that we are overestimating the number 
of faint ellipticals in our sample. Correcting for this bias 
would make the discrepancy with the hierarchical model 
even larger. 

We conclude that the PLE model better reproduces 
the observed number counts of the SWAN galaxies. In 
Fig. El the contributions of the different galaxy types 
to the total observed number counts according to the 
PLE model are shown. The separation between the two 
populations of dE and gE galaxies proves to be a key 
element in reproducing the number counts separated by 
morphological type on the basis of their light profiles. 
In fact, the number counts for exponential- like profiles 
would have been underestimated for Ks > 20, and the 
r^/* profiles number counts overestimated, had the dE 
galaxies been included in the early-type morphological 
bin along with the gE galaxies. This result confirms the 
suggestions of Totani et al. (.2001.1 that such a separation 
better reproduced the observed number counts in the 
Subaru Deep Field for K >20 than a model with a single 
elliptical population. 

In Fig. ^1 the observed size-magnitude distribution 
discriminating between late-type and early-type galax- 
ies is compared with the model predictions. At bright 
magnitudes, the observed galaxies are smaller than the 
model predictions for both early-type and late-type sam- 
ples. This discrepancy is likely due to an uncorrected sys- 
tematic effect: large {Re > 1") bright galaxies can be self- 
subtracted in the reduction process, as explained in sec- 
tion 0] This phenomenon will reduce the apparent sizes of 
sources, although their integrated magnitudes (and thus 
their contributions to the number counts) will be only 
minimally affected. 

At faint magnitudes, the models are able to repro- 
duce the observed distributions for early- type galaxies. 
However, the PLE model better reproduces the observed 
distribution at fainter magnitudes, where the hierarchical 
model predicts more compact objects than are observed. 
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Fig. 10. Comparison of the distribution as a function of magnitude of late-type (left panel) and early-type galaxies 
(right panel) with < 2 in the GALFIT fit with the PLE model (solid line) and hierarchical model (dashed line) 
predictions. The error bars are the standard error on the mean; no error bar is drawn for a bin with one galaxy. 



In contrast, an offset may exist between both models 
and the data for late-type galaxies, which appear ^ 30% 
smaller than predicted at faint magnitudes. This offset is 
what would be expected for modest growth in the sizes of 
late-type galaxies. In both of the models considered here, 
the sizes of disks for a given mass are almost independent 
of the formation redshift. This property is built into 
any PLE model, but even the hierarchical model by 
Nagashima et al. (j2()()5|l assumes that there is almost no 
evolution in the stellar mass-size relation for disk galaxies, 
as suggested by the observations of Barden et al. (2005) 
up to 2 1 . If our observed offset is really due to increses 
in size in the late-type population, the result would be 
qualitatively consistent e.g. with the predictions of Mo 
et al. l|1998|l . who estimated that disk galaxies forming 
at z = 1 are 50% smaller than disks forming at z = 0. 
However, the inclusion of galaxies with many different 
redshifts, masses, and M/L ratios in the faint bins of 
Fig. llOb prevents any robust quantitative conclusion. 

Our finding that pure luminosity evolution of galaxies 
is favored for a iiTs-selected sample up to Kg ^ 22, with- 
out evidence of relevant number evolution even when sep- 
arating between late and early-type galaxies is consistent 
with other results. For example, TruijUo et al. ('20 055 used 
deep near-infrared images from the FIRES survey, com- 
bined with GEMS and SDSS data, to confirm that the ob- 
served size-magnitude relation evolution out to z ~ 1.7 for 
late-type objects matches very well the expected evolution 
for Milky- Way type objects from infall models, while for 
spheroid-like objects the evolution of the luminosity-size 
relation was found to be consistent with pure luminosity 
evolution of a fading galaxy population. Mcintosh et al. 
I|200 51 studied a large sample of early-type galaxies from 
the GEMS survey, finding that the luminosity-size and 



stellar mass-size relations evolve in a manner that is con- 
sistent with the passive aging of ancient stellar population. 
Papovich et al. I|2005(l suggest that passive evolution can 
account for the observed luminosity-size relation at z ~ 1 , 
with merging becoming important at higher redshifts. 

10. Conclusions 

In this paper we have presented new results from a high 
resolution adaptive optics assisted morphological study of 
21 fields from SWAN, the Survey of a Wide Area with 
NACO. The PSF model derived in Paper I was used in 
combination with GALFIT to classify the SWAN galaxies 
into the two classes of early and late type, and to de- 
rive effective radii of 383 galaxies. A detailed study of 
the detection probability as a function of the magnitude, 
Sersic index, effective radius, field and distance from the 
guide star was performed in order to take careful account 
of the selection effects affecting our sample. The results 
were used to compute the completeness-corrected num- 
ber counts and to derive the average Re as a function of 
magnitude. 

The number counts and size- magnitude relation for the 
total galaxy population, and for early and late-type sep- 
arately, were compared with both a modified version of 
the pure luminosity evolution model of Totani & Yoshii 
( 2000) and with the a priori hierarchical model developed 
by Nagashima et al. ^2005^. We have shown in sectional 
that while the hierarchical model can convincingly repro- 
duce the counts of late- type galaxies, it is not consistent 
with the observed number counts of elliptical galaxies se- 
lected in the Kg band. On the other hand, the PLE model 
can reasonably reproduce both the late and early type 
count distributions for the SWAN galaxies. We have com- 
pared the size-magnitude distribution of the galaxies with 
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the predictions of the models, finding that there might be 
some hint of increased size for the late- type galaxy popula- 
tion. Both models are consistent with the observed distri- 
bution for early-type galaxies, although the PLE model 
seems to better reproduce the observed distribution at 
fainter magnitudes. Our work therefore favors pure lumi- 
nosity evolution of early-type galaxies for a i^g-selected 
sample up to ^ 22. In contrast, our results show that a 
representative example of currently available models based 
on the hierarchical galaxy formation theory is not able 
to reproduce the observed properties of faint ifg-selected 
early-type galaxies in the near-IR. 

These results illustrate the importance of obtaining re- 
liable morphological classifications for better constraining 
the details of galaxy formation and evolution models, and 
demonstrate the unique power of AO observations to ex- 
tend such work to faint galaxies in the near-IR. 
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